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A first-order digital phase locked loop is analyzed 
by application of a Markov chain model. Steady- 
state loop error probabilities, phase standard 
deviation and mean loop transient times are deter- 
mined for various input signal-to-noise ratios. In 
addition, results for direct loop simulation are 
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CONCLUSIONS AND OBSERVATIONS 


A specific first-order phase locked loop has been modeled as a first-order Markov 
process and the appropriate analysis carried out to determine the steady-state probabilities 
of the loop's phase states, the standard deviation of the loop's output phase and the mean 
time to lock for some known initial phase offset. The comparison of these values for a 
particular loop configuration with values obtained by simulation of the loop indicate that 
the proposed model is valid. The state diagram itself is not limited to the case of in- 
dependent input samples but the analysis would have to be carried out for an n^ order 
Markov process if the samples are not statistically independent. 

The model as presented is limited to a first-order phase locked loop by the fact 
that the state diagram allows transitions only to adjacent states. If the state diagram 
allowed transitions to states other than only the adjacent states then a second-order loop 
results. However, the transition probabilities must be such that the matrix of transition 
probabilities is stochastic if the analytic techniques described in the previous sections 
are to be of value. 


II. INTRODUCTION 

Digital phase locked loops are of particular interest because of the inherent ease 
with which they can be designed and constructed. However, little is known about the 
output phase characteristics of DPLL's when the input signal is corrupted by noise. In 
[13, a class of DPLL's was subjected to a noise analysis but simplifying assumptions made 
limit the usefulness of the results to small values of phase error only. In [2] and [33, 
specific DPLL configurations were analyzed utilizing random-walk techniques. A DPLL 
is described in the following that achieves the same statistical curve characteristics but 
less physical complexity than that described in [33. 

The following deals with a specific first-order DPLL configuration and utilizes the 
theory of first order Markov processes in the analysis. The specific loop configuration 
used is that of the Ohio University MAPLL [43 with the exception that the loop is assumed 
to operate continuously instead of in a gated manner. The main thrust of this paper is to 
present a method of analysis for this loop configuration (and many similar loop configurations) 
and not necessarily io provide a detailed design for any particular DPLL application. As 
an example of the usefulness of the approach, results are provided for a DPLL whose out-' 
put phase is quantized to 32 distinct values. Results are also provided for a DPLL simulation 
as a check on the correctness of the analytic method. 

t 

III. MARKOV CHAIN MODEL FOR A DPLL 

Consider the first-order digital phase locked loop of Figure 1. For this loop, the 
reference clock is the same frequency as the incoming signal s(t) and can take on N 
distinct phases defined between 0 and 2tr. These values are spaced 2n/N radians apart. 

The operation of the phase detector is to sample the incoming signal at a time coincident 










with the positive going zero crossing of the reference clock and provide an output based 
on the sign of the sampled value. See Figure 2, If the sample value of the incoming signal 
is less than zero, the phase detector provides an increment output and if the sample value 
is greater than zero, a decrement output. Assume that the divide-by M and the divide-by 
N counters are initially zero and the random noise is zero and the incoming signal phase 
lags the reference clock phase. The sampled value then is less than zero so that the 
phase detector output causes the divide-by M counter to increment one count. Since 
the value of the divide-by N counter does not change, the next sample will also be 
less than zero again causing the divide-by M counter to increment one count. This con- 
tinues until the divide-by M counter overflows and thus increments the divide-by N 
counter by one count which in turn retards the phase of the reference clock by 2rr/N 
radians. The divide-by N counter is thus successively incremented until the reference 
clock phase lags the incoming signal phase at which time the phase detector samples 
are now positive causing the divide-by M counter to decrement one count for each such 
sample taken. The loop then is in lock and the reference clock phase is equal to the 
incoming signal phase within the quantization error. 

From the preceding, it is obvious that to change the phase of the reference clock 
it is necessary for the divide-by M counter to cycle through its M distinct states to either 
an overflow or underflow condition. Thus while the phase output takes on N distinct 
states, the loop itself has M*N distinct states. A state diagram for the loop is given In 
Figure 3 where the p.'s end the q.'s are the probabilities associated with the indicated 
state changes. More will be said about these values in a moment. Several things are 
vtorth noting about this state diagram. First, for any present state, when a new sample 
is taken a new state will result; and second, the new state will always be "adjacent" to 
the previous state. Also, for a given reference clock state the transitions occur uniformly 
with time but, following a transition from one reference clock state to another, the 
time interval to the next sample is either longer or shorter than the time interval between 
the previous two samples depending on whether the reference clock phase was advanced 
or retarded as it passed from the previous reference clock state to the present reference 
clock state. 


Assume that the input to the DPLL is 
s r (t) = s(t) + n(t) 

= A cos(u t + iji) + x(t)cos<J t+y(t)sin<J t 
CO c c 

where A is the carrier amplitude and x(t) and y(t) are zero mean independent gaussian 
distributed random processes of bandwidth B and variance cr x ^ = cr 2 = cr^. That is, the 
input to the DPLL is some signal plus narrowband noise. The inpdt can also be written 
in the form: 

S O') = x'(t)cosu t+y l (t)sinco t 
r c c 
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Figure 3. First-Order DPLL State Diagram. 



where 


x’(t) = x(t) + A cos ip 
c 

y*(0 “ y(0 + A sin ip 

c 

The positive going zero crossing is always assumed to be the correct phase of the signal s(t). 
That. is, the reference clock is always assumed to be in phase lock with the signal s(t), and 
the error signal generated b> the phase detector is used to tell the loop differently. There- 
fore, the loop always assumes the samples of the incoming signal occur at: 

u t.= (1 + 2i)ir/2 i =0, 1, 2, . . . 

c i 

so that 


cos u t = 0 
c 

sin u t = 1 
c 

giving 

s(t) = y(f) + A sin'.}) 

I C 

where ip is the phase difference between s(t) and the reference clock. Note that as the 

loop approaches lock, (}i approaches 0. Also, the reference clock can take on only N 

distinct values so that tp too can take on only N distinct values ijjj, i — 1, 2, . . ., N. 

From earlier y(t) is a gaussian distributed random process so that the probability density 

function for s (t) is: 
r 

1 (y + A sin iji. ) 2 

2 C I 

2 
a 


P( s r ) 


\/2ttC r 2 


From the state diagram of Figure 3, the p. 1 s are the probability that the sampled value of 
s (t) is less than zero and can be found from: 


P- / p(s U- ) ds 

r, «/ r\ r J | r 

-CO 


y + A sin i|). 

O C- ^-J 

— / <T 2 


\/2ircr 2 - 


dy 


oo 


- probability that s (t) 0 
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Also, 


q. " 1 - p. 

i 

a probability that s^(t) >0 

If the samples are independent and the non-uniform sampling interval is ignored, 
then the DPLL given by the state diagram of Figure 3 can be approximated by a Markov 
chain. Define afj as the probability that the loop is in stjte s;j. Then the system of 
equations describing the loop probabilities are given as: 


0 Pj 0 0 0 0 

qj 0 Pj 0 0 0 

0 qj 0 pj 0 0 
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P N 0 0 0. . 



0 q l~ 


a ll 


a li ’ 

0 0 
0 0 


a 12 

• 

• 

• 


°I2 

• 

• 

• 



°1M 


°1M 



a 21 


°21 

• 


a 22 

• 

• 


°22 

• 

• 

• 

• 


• 

a 2M 


• 

°2M 

• 

• 

• 


• 

- 

• 

• 

• 

• 

• 


°NI 


• 

• 

°N1 

• 


a N2 

• 


°N2 

• 

z 

a. 

o 


• 

• 

• 


• 

• 

-Q 

z 

o 

I 


“nm 


"nm 



where P is called the matrix of transition probabilities. The norv-trivial solution to this 
system of homogeneous, linear equations is the one that satisfies: 


N M 
I Z 

i = l, i = l 



and, from the characteristics of Markov chains, represents the steady-state probabilities 
for the loop states. That is, at any given instant of time the probability of observing the 
loop in state sjj is given by a|j. The steady-state probabilities for the reference clock 
states, Sj, are given by: 



i “ 1, 2, ..., N 


Once the steady-state reference clock state probabilities are known, it is possible to find 
the variance of the reference clock phase from: 


cr“= I S C(ir/N){l+2i)r 
' i = 1 ' 

where it has been assumed that the phase of the incoming signal s(t) is tt radians. 

Another quantity useful for the evaluation of a DPLL is the mean time to lock-up 
for some initial phase offset. To evaluate this, the Markov chain approximation is again 
used. Let p;j be the ij^ element of [p] and renumber the loop states s.j by consecutively 
numbered subscripts as: 



S N.M S (N*M) 

Then if the system starts in state S; , the waiting time up to the first passage through state 
sj has a distribution ft!?'. That is, fjp) is the probability that starting in state s., the first 

occurrence of state s.'^is at time n. 1 The values of f(*?) can be found from: 

1 'I 



and 


f<?> = P ! n) - 

•I 'I 


n - 1 

I 

k= 1 


(n-k) (k) 

I • * H* • 

M »i 


where pjj^ is the i]^ element of P^. 

initial state is s, then is: 
l 


H 



00 

1 

n = 1 



The mean time to the first occurrence of s. if the 

1 


For the dimension of the square matrix P on the order of 500X500 (for instance 
N — 64 and M = 8) the determination of the elements of P^ directly is time consuming even 
when implemented for computer solution. Therefore, alternate methods to determine p(k) 
are desired. One method of solution is to form a generating function as outlined by l * 
Feller [53. While this method results i a function that allows the evaluation of p>. ' 
as a function of k ; it involves the solution of two sets of nxn simu Ltaneaus equations 1 ' 
and the determination of the roots of a n^ 1 order polynomial. Another method of solution 
would be to find the eigenvalues and eigenvectors of matrix P and convert if to Jordan 
canonical form by similarity transforms. Then the higher powers of the Jordan canonical 
form matrix could be easily found with p|W determined from the inverse transform. Note, 
If is not required to find all the elements of P . This method is attractive from the stand- 
point that literature concerning the determination of eigenvalues and eigenvectors is 
read! ly available. 


A more direct method for finding the mean time to the occurrence of sj given present 
state sj is suggested by Feller [53 and derived by Cessna and Levy [33. As in [33, let l Q (i) 
be the expected value of time to reach minimum phase error when the initial state is 
state i. Then T (i) satisfies the following difference equation: 

T o 0) = T(i) + P (i)*T o (i-1) + q(i)*T o (i+1) 

with boundary conditions T Q (0) = 0 and T(i) the expected duration of state i. For the State 
diagram of Figure 3, T(i) = 1. Thus, a set of non-homogeneous linear simultaneous equations 
has been defined, the solution of which is readily found. 


IV. APPLICATION OF THE MARKOV CHAIN MODEL 

The steady-state probabilities for different values of M and N were found by a 
successive approximation algorithm in a computer program. An envelope of the steady- 
state probabilities for N = 32 and M — 4 is shown in Figure 4 for signal-to-noise ratios 
of 0 dB and -20 dB. Notice that at the decreased signal-to-noise ratio the density 
function’s peak is down and the function has "flattened out" considerably. This is 
expected since the noise has become more significant making the steady-state probabilities 
more nearly equal. 
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Figure 4. First-Order DPIL Output Phase Probability Density Function. 
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Once the steady-state probabilities are determined the phase variance (or standard 
deviation) can be easily calculated. For N = 32 orv? M = 4, 8 , and 16, the phase standard 
deviation versus signal-to-noise ratio wore calculated. The results are plotted in Figure 5, 
Note, these curves are plotted for noise-to-signal ratios. For low values of noise-to-signal 
ratio, the curves are asymptotic to a value fixed by N, the quantization level of the reference 
clock phase. For high values of noise-to-s'i ^nal ratio the curves are asymptotic to the standard 
deviation of a uniform phase distribution. T Sis is caused by the flattening of the phase 
density function as the noise-to-signal ratio increases. Simulation results for N = 32, 

M - 4 are also provided in Figure 5. These show close agreement to the theoretical 
results. 

The mean time to loop lock-up in terms of the number of samples required was 
determined by solving the difference equation given previously. The values of M and 
N were fixed to 4 and 32, respectively, so that the loop had 128 states and the incoming 
signal phase was assumed to be tt radians so that loop lock occurred in either states 554 
or s,„. The boundary conditions for the difference equations then are T (64) and T Q (65) 
equals zero. This set of difference equations was solved by a successive approximation 
technique for different values of signal-to-nois® ratio and the results are plotted in Figure 
6 . As expected for a given initial phase offset, the mean number of samples required to 
achieve phase lock increases as signal-to-noise ratio decreases. Notice that for a 20 dB 
signal-to-noise ratio that the expected time to lock is very nearly that of the noiseless 
case. That is, for the maximum error between the input phase and the DPLL, the DPLL 
would have to step through 63 transitions to reach the lock state and Figure 6 indicates 
that for 20.0 dB the expected number of samples required is 64.2. Figure 7 is a similar 
plot except that the signal-to-noise ratio was held constant and the value of M was set 
to both 4 and 8 . From this plot, for a fixed signal-to-noise ratio and a fixed phase 
offset, the mean time to lock increases as the number of states increases. Simulation 
results are also provided in Figure 6 for M - 4, N = 32. The mean time to lock for 
the simulation shows close agreement with the theoretical results. 
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Lock-Up Versus Initial Phase Error. 
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